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(54) image processing apparatus 

(57) An image processing apparatus includes a 
spatial filter and orthogonal transform section. The spa- 
tial filter obtains a new luminance value of each pixel of 
an input image on the basis of a first coefficient having 
a first filter characteristic which forms the desired spatial 
frequency adjustment filter characteristic in cooperation 
with a second filter characteristic, thereby generating a 
two-dimensional intermediate image which has the 
adjusted spatial frequency characteristic of the input 
image. The orthogonal transform section performs two- 
dimensional orthogonal transform for the intermediate 
image on the basis of a second coefficient which has 
the second filter characteristic, which forms the desired 
spatial frequency adjustment filter characteristic in 
cooperation with the first filter characteristic, and is used 
for two-dimensional orthogonal transform for compress- 
ing the intermediate image generated by the spatial fil- 
ter, thereby generating image data which has the 
adjusted spatial frequency characteristic of the interme- 
diate image and has undergone two-dimensional 
orthogonal transform for image compression. 
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Description 

Background of the Invention 

[0001] The present invention relates to an image 
processing apparatus and, more particularly, to an 
image processing apparatus for adjusting, at a high 
speed, the spatial frequency characteristic of a two- 
dimensional image sensed by an electronic camera 
apparatus when the image is to be compressed and 
recorded at a high speed. 

[0002] An electronic camera apparatus (digital still 
camera) for sensing an image using an image sensing 
section such as a CCD adjusts the spatial frequency 
characteristic of an obtained two-dimensional image 
and compresses the image. 

[0003] For example, an image obtained by a CCD 
using a color filter is constructed by a number of pixels 
having luminance values of different color components 
such as R, G, and B components. For this reason, pixels 
of the same color component are arranged in a check- 
erboard pattern, and actual resolution with respect to 
the number of pixels is low. 

[0004] A general electronic camera apparatus exe- 
cutes processing of adjusting the spatial frequency 
characteristic of an input image whereby edge enhance 
or other image processing is performed for the input 
image to compensate for such deterioration in resolu- 
tion. 

[0005] In recent years, resolution tends to be 
improved by increasing the number of pixels of a CCD, 
and an enormous memory capacity is required to store 
(record) an obtained image. 

[0006] Hence, in the general electronic camera 
apparatus, image compression processing is performed 
to reduce the data capacity using two-dimensional 
orthogonal transform without largely damaging the 
quality of an input image. 

[0007] Rg. 20A shows the arrangement of a con- 
ventional electronic camera apparatus. 
[0008] An image (RGB) photoelectrical^ converted 
by an image sensing section 1 1 constituted by a CCD is 
digitized by a signal conversion section 12. After various 
conversion processes including luminance/color differ- 
ence signal conversion, color temperature correction, 
and gamma correction are executed, the image is tem- 
porarily stored in a memory 13. 

[0009] An image processing apparatus 15 has a 
signal processing section 16 for adjusting the spatial 
frequency characteristic of the sensed image, a two- 
dimensional orthogonal transform section 18 for per- 
forming two-dimensional orthogonal transform for the 
image with the adjusted spatial frequency characteris- 
tic, and a quantization/compression section 18B for 
quantizing and compressing the transformed image 
data. 

[0010] The signal processing section 16 is con- 
structed by a general-purpose circuit section such as a 



DSP (Digital Signal Processor). 

[0011] In this case, on the basis of an instruction 
from a control section 16B, image data 14 is sequen- 
tially read out from the memory 13, and predetermined 

5 floating-point operation is repeatedly executed using a 
filter coefficient 16A having a desired filter characteristic 
for spatial frequency characteristic adjustment to gener- 
ate an intermediate image 17 having an adjusted spatial 
frequency characteristic. 

10 [0012] The two-dimensional orthogonal transform 
section 18 is constructed by a general circuit section for 
performing two-dimensional orthogonal transform 
processing such as DCT (Discrete Cosine Transform). 
[0013] In this case, two-dimensional orthogonal 

15 transform processing for the intermediate image 17 is 
performed using a transform coefficient 18A for image 
data compression. 

[0014] After that, the quantization/compression 
section 18B quantizes and compresses the image data 

20 that has undergone two-dimensional orthogonal trans- 
form to obtain compressed image data 19. 
[0015] In this conventional image processing appa- 
ratus, complex floating-point operation is repeatedly 
executed using the signal processing section con- 

25 structed by the general-purpose DSP, thereby adjusting 
the spatial frequency characteristic of an input image. 
[0016] For this reason, the spatial frequency char- 
acteristic cannot be arbitrarily adjusted on the basis of a 
desired characteristic because of limitations on the time 

30 required for calculation and power consumption. 

[0017] Generally, in adjusting the spatial frequency 
characteristic in units of matrix spaces each con- 
structed by M x M pixels (M is an odd number; M s 3) of 
an input image, the spatial frequency characteristic can 

35 be arbitrarily adjusted in a wide frequency band by 
increasing the space size M. 

[0018] However, the number of times of calculation 
by the DSP increases in proportion to the square of M, 
and the processing time and power consumption also 
40 increase. 

[0019] In conventional image processing, to reduce 
the number of times of calculation, relatively simple 
adjustment is performed for the spatial frequency char- 
acteristic. More specifically, the spatial frequency char- 
45 acteristic is adjusted in units of small matrix spaces with 
a size of 3 x 3 pixels (M = 3). 

[0020] Hence, the degree of freedom of a charac- 
teristic in adjusting the spatial frequency characteristic 
is considerably limited, and no satisfactory image 
so processing can be realized. 

Suminaryjpf jtheJnyje.nt!.P_o 

[0021] The present invention has been made to 
55 solve the above problem, and has as its object to pro- 
vide an image processing apparatus capable of adjust- 
ing the spatial frequency characteristic of an input 
image and compressing the image using a desired filter 
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characteristic. 

[0022] In order to achieve the above object, accord- 
ing to the present invention, there is provided an image 
processing apparatus which, for an input two-dimen- 
sional image constructed by arraying, in a matrix, a 
number of pixels each representing a luminance value 
at a corresponding position, adjusts a spatial frequency 
characteristic on the basis of a desired spatial fre- 
quency adjustment filter characteristic, and compresses 
the image, comprising a spatial filter for obtaining a new 
luminance value of each pixel of an input image on the 
basis of a first coefficient having a first filter characteris- 
tic which forms the desired spatial frequency adjust- 
ment filter characteristic in cooperation with a second 
filter characteristic, thereby generating a two-dimen- 
sional intermediate image which has the adjusted spa- 
tial frequency characteristic of the input image, and an 
orthogonal transform section for performing two-dimen- 
sional orthogonal transform for the intermediate image 
on the basis of a second coefficient which has the sec- 
ond filter characteristic, which forms the desired spatial 
frequency adjustment filter characteristic in cooperation 
with the first filter characteristic, and is used for two- 
dimensional orthogonal transform for compressing the 
intermediate image generated by the spatial filter, 
thereby generating image data which has the adjusted 
spatial frequency characteristic of the intermediate 
image and has undergone two-dimensional orthogonal 
transform for image compression. 

Brief Descri ption of the Drawings 

[0023] 

Fig. 1A is a block diagram of an electronic camera 
apparatus to which an image processing apparatus 
according to the first embodiment of the present 
invention is applied; 

Fig. 1 B is an explanatory view showing adjustment 
of a spatial frequency characteristic; 
Fig. 2 is an explanatory view showing an example 
of a one-dimensional DCT filter characteristic for 
spatial frequency adjustment, which is used by an 
orthogonal transform section; 

Fig. 3 is an explanatory view showing generation 
examples of two-dimensional DCT filter character- 
istics for spatial frequency adjustment; 
Fig. 4 is a view showing a 3D model representing 
the two-dimensional DCT filter characteristics for 
spatial frequency adjustment; 
Figs. 5A and 5B are explanatory views showing 
generation examples of two-dimensional DCT 
transform coefficients for spatial frequency adjust- 
ment and two-dimensional orthogonal transform; 
Figs. 6A and 6B are explanatory views showing 
DCT transform results using DCT transform coeffi- 
cients having a high-frequency attenuation charac- 
teristic; 



Figs. 7A to 7C are schematic views showing a 
matrix space used by a spatial filter; 
Figs. 8A and 8B are explanatory views showing the 
arrangement of a spatial filter according to the sec- 

5 ond embodiment of the present invention; 

Fig. 9 is a block diagram showing the detailed 
arrangement of the spatial filter; 
Fig. 10 is a block diagram showing the detailed 
arrangement of the spatial filter; 

w Fig. 1 1 is a block diagram showing another detailed 
arrangement of the spatial filter; 
Fig. 12 is an explanatory view showing the fre- 
quency characteristic of the spatial filter; 
Fig. 1 3 is an explanatory view showing the arrange- 

15 ment of a spatial filter according to the third embod- 
iment of the present invention; 
Fig. 1 4 is an explanatory view showing the arrange- 
ment of a spatial filter according to the fourth 
embodiment of the present invention; 

20 Fig. 15 is a block diagram showing the detailed 
arrangement of the spatial filter; 
Fig. 16 is a block diagram showing the detailed 
arrangement of the spatial filter; 
Fig. 17 is an explanatory view showing the fre- 

25 quency characteristic of the spatial filter; 

Fig. 18 is a view showing a 3D model representing 
the frequency characteristics of the spatial filter; 
Fig. 19 is a view showing a 3D model representing 
the synthesized characteristics of a spatial filter and 

30 two-dimensional DCT filter; and 

Fig. 20 is a block diagram showing an electronic 
camera apparatus to which a conventional image 
processing apparatus is applied. 

35 Description of the Preferred Embodiments 

[0024] The present invention will be described 
below with reference to the accompanying drawings. 
[0025] Fig. 1 A shows an electronic camera appara- 
40 tus to which an image processing apparatus according 
to the first embodiment of the present invention is 
applied. Fig. 1B shows adjustment processing of a spa- 
tial frequency characteristic. 

[0026] An image (RGB) photoelectrical^ converted 
45 by an image sensing section 1 1 constructed by an 
image sensing element such as a CCD is digitized by a 
signal conversion section 12. After various conversion 
processes including luminance/color difference signal 
conversion, color temperature correction, and gamma 
so correction are executed, the image is temporarily stored 
in a memory 13. 

[0027] This image is constructed by a number of 
pixels arrayed in a matrix. Each pixel has a luminance 
signal Y and luminance values of two color difference 
55 signals. 

[0028] An image processing apparatus 1 has a spa- 
tial filter 2 which adjusts the spatial frequency character- 
istic of an input image 14 (luminance signal Y) read out 
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from the memory 13 on the basis of a filter coefficient 
2A (first coefficient) having a filter characteristic (first fil- 
ter characteristic) for spatial frequency adjustment to 
obtain an intermediate image 6. 

[0029] The image processing apparatus also has a 
two-dimensional orthogonal transform section 4 for per- 
forming two-dimensional orthogonal transform for spa- 
tial frequency characteristic adjustment and 
compression processing for the intermediate image 6 
obtained by the spatial filter 2, on the basis of a coeffi- 
cient 4A (second coefficient) having two characteristics, 
i.e., a filter characteristic (second filter characteristic) for 
spatial frequency adjustment and a transform coeffi- 
cient for two-dimensional orthogonal transform. 
[0030] A quantization/compression section 18B 
quantizes and compresses the image data which has 
undergone two-dimensional orthogonal transform, 
thereby obtaining compressed image data 1 9. 
[0031] As the spatial filter 2, a DSP may be used, as 
in the prior art, or an optimized circuit section may be 
used, as in the embodiment to be described later. 
[0032] The two-dimensional orthogonal transform 
section 4 is constructed by a gen era I -purpose circuit 
section for performing two-dimensional orthogonal 
transform such as DCT. 

[0033] In the present invention, as shown in Fig. 1 B, 
a desired filter characteristic 7 for spatial frequency 
adjustment in the entire image processing apparatus 1 
is separated into a filter characteristic 7 A (first filter 
characteristic) and filter characteristic 7B (second filter 
characteristic). The spatial filter 2 and two-dimensional 
orthogonal transform section 4 adjust the spatial fre- 
quency using filter coefficients 2A and 4A representing 
the filter characteristics, respectively. 
[0034] That is, the filter characteristics 7 A and 7B 
cooperatively synthesize the desired filter characteristic 
7 for spatial frequency adjustment. 
[0035] When the desired filter characteristic 7 for 
spatial frequency adjustment is separated into the filter 
characteristics 7A and 7B respectively matching the 
processing performances of the spatial filter 2 and two- 
dimensional orthogonal transform section 4, and the 
spatial frequency characteristic is adjusted by both the 
spatial filter 2 and two-dimensional orthogonal trans- 
form section 4, two-dimensional orthogonal transform 
for spatial frequency characteristic adjustment and 
compression processing can be performed for the input 
image 14 using the desired filter characteristic without 
adding any new circuit arrangement, unlike the prior art 
using a single filter characteristic. 
[0036] Generally, in adjusting the spatial frequency 
adjustment by the spatial filter 2, the spatial frequency 
characteristic is adjusted in units of matrix spaces each 
constructed by an arbitrary central pixel on the input 
image and MxM pixels (M is an odd number; M s 3) in 
the periphery. 

[0037] To obtain a desired characteristic in the inter- 
mediate- and high-frequency ranges of the spatial fre- 



quency characteristic, a relatively large matrix space 
need be used. 

[0038] For this purpose, the desired filter character- 
istic 7 for spatial frequency adjustment is separated into 

5 the two filter characteristics 7A and 7B. As the filter 
characteristic of the filter coefficient 2A used by the spa- 
tial filter 2, generally having desired characteristic 7 with 
mainly adjusting the characteristic of the intermediate- 
to high-frequency ranges. As the filter characteristic of 

10 the transform coefficient 4A used by the two-dimen- 
sional orthogonal transform section 4, a characteristic 
with mostly adjusting characteristic of the high-fre- 
quency range of the desired filter characteristic 7 is pre- 
pared. 

15 [0039] With this method, a relatively free and com- 
plex spatial frequency characteristic can be obtained 
without increasing the matrix space (M pixels) to be 
processed by the spatial filter 2. 

[0040] When image data converted into a fre- 

20 quency space by two-dimensional orthogonal transform 
is subjected to filter processing, the spatial frequency is 
adjusted only in the closed matrix space, a luminance 
value difference, i.e., block distortion is generated 
between adjacent matrix spaces. 

25 [0041] Especially, when DCT is used, the change in 
luminance value tends to be relatively large at the 
peripheral portion of the matrix space, so the spatial fre- 
quency cannot be largely adjusted. 
[0042] However, according to the present invention, 

30 since the two-dimensional orthogonal transform section 
4 adjusts the characteristic in the highest-frequency 
range, the characteristic in the low- to intermediate-fre- 
quency ranges need not be adjusted, and the block 
noise can be suppressed. 

35 [0043] Especially, to enhance the edge of an input 
image by adjusting the spatial frequency characteristic, 
as the filter characteristic 7A, a characteristic with a 
peak from the intermediate- to high-frequency portions 
is used, as shown in Fig. 12 or 17. As the filter charac- 

40 teristic 7B of the two-dimensional orthogonal transform 
section 4, a characteristic that cannot be realized by the 
spatial filter 2, i.e., that attenuates in the high-frequency 
range, as shown in Fig. 2 (to be described later), is 
used. 

45 [0044] In this case, clear compressed image data 
with an emphasized high-frequency range and free from 
granular appearance can be obtained at a high speed 
and low power consumption without increasing the 
number of times of calculation by the spatial filter 2. 

so [0045] In addition, when the spatial frequency char- 
acteristic of a color difference signal is adjusted using a 
characteristic different from that for a luminance signal, 
for example, the high-frequency portion can be greatly 
attenuated as compared to the luminance signal, so 

55 processing equivalent to chromakeying can be per- 
formed. 

[0046] A method of obtaining the transform coeffi- 
cient 4A used by the two-dimensional orthogonal trans- 
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form section 4 will be described next by exemplifying 
DCT. 

[0047] The transform coefficient 4A has both the fil- 
ter characteristic 7B for spatial frequency adjustment 
and a transform coefficient for two-dimensional orthog- 5 
onal transform. 

[0048] Fig. 2 shows an example of a one-dimen- 
sional DCT filter characteristic for spatial frequency 
adjustment which is performed by the two-dimensional 
orthogonal transform section. w 
[0049] As a one-dimensional DCT filter characteris- 
tic, a Sin 8 9 high-frequency attenuation filter having four 
sample points is shown. 

[0050] When this one-dimensional DCT filter char- 
acteristic is arranged in the X and Y directions, as 75 
shown in Fig. 3, and coefficients X(x) and Y(y) are mul- 
tiplied, a two-dimensional DCT filter characteristic, i.e., 
a coefficient W(x,y) of the filter characteristic 7B is 
obtained. 

[0051] Fig. 4 shows a 3D model representing the 20 
two-dimensional DCT filter characteristics. 
[0052] Fig. 5A shows transform coefficients used 
for DCT transform by the two-dimensional orthogonal 
transform section 4. When these transform coefficients 
and two-dimensional DCT filter coefficients shown in 25 
Fig. 3 are multiplied at the respective sample points, the 
transform coefficients 4A having the filter characteristic 
78 are obtained, as shown in Fig. 5B. 
[0053] Figs. 6A and 6B show DCT transform results 
using DCT transform coefficients having a high -f re- 30 
quency attenuation characteristic. Fig. 6A shows pixels 
(luminance values) before DCT processing. Fig. 6B 
shows pixels (luminance values) which have undergone 
DCT processing (compression) and then inverse DCT 
processing (expansion). 35 
[0054] Comparison between these pixels indicates 
that the luminance differences between pixels are 
smaller in Fig. 6B than in Fig. 6A, i.e., the spatial fre- 
quency is attenuated in the high-frequency range. 
[0055] When an original transform coefficient used 40 
for two-dimensional orthogonal transform is multiplied 
by a filter coefficient for spatial frequency adjustment, 
which has the filter characteristic 7B, the transform 
coefficient 4 A having both characteristics can be 
obtained. 45 
[0056] When the two-dimensional orthogonal trans- 
form section 4 performs two-dimensional orthogonal 
transform using the transform coefficient 4A, two- 
dimensional orthogonal transform for spatial frequency 
characteristic adjustment and image compression is so 
executed at once. For this reason, transform processing 
for spatial frequency characteristic adjustment using the 
filter characteristic 7B need not be separately per- 
formed, and the processing time and power consump- 
tion can be suppressed. 55 
[0057] As the spatial filter 2, an arrangement for 
adjusting the spatial frequency characteristic in units of 
matrix spaces each having M x M pixels (M = 3 to 5) 
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using a DSP can be used, as in the prior art. 
[0058] As filter coefficients used in this case, the 
sum of power values of 2 may be used as a central coef- 
ficient corresponding to the central pixel of a matrix 
space, and a peripheral coefficient corresponding to a 
peripheral pixel of the matrix space except the central 
pixel may be selected such that the sum of the central 
coefficient and the total sum of the peripheral coeffi- 
cients has a power value of 2. 

[0059] Examples of filter coefficients satisfying the 
above conditions are shown in Figs. 8A and 14A (to be 
described later). 

[0060] When such a filter coefficient is used, the 
calculation process for spatial frequency characteristic 
adjustment by a DSP can be realized by addition of inte- 
gers or multiplication and division (i.e., bit shift) of a 
power value of 2 with respect to an integer without using 
floating-point operation, unlike the prior art. 
[0061] Hence, the processing time can be short- 
ened, and power consumption can be reduced as com- 
pared to a case wherein another filter coefficient is 
used. 

[0062] In addition, by exploiting the excess process- 
ing time and power consumption, the spatial frequency 
characteristic can be adjusted at a high speed even 
using a larger matrix space (for example, M = 7 or 
more), and a considerably delicate filter characteristic 
7A can be realized. 

[0063] The second embodiment of the present 
invention will be described next with reference to Figs. 
7A to 8B. 

[0064] Figs. 7A to 7C show a matrix space used by 
a spatial filter. Figs. 7A and 7B show a pixel arrange- 
ment, and Fig. 7C shows filter coefficients. 
[0065] Figs. 8A and 8B show a spatial filter accord- 
ing to the second embodiment. Fig. 8A shows filter coef- 
ficients, and Fig. 8B shows a block diagram 
[0066] In the above-described first embodiment, a 
general-purpose DSP is used as the spatial filter 2. In 
the second embodiment, a case wherein a spatial filter 
2 is constructed by a circuit section for performing pipe- 
line processing will be described. 

[0067] Note that pipeline processing means 
processing of sequentially reading input data, process- 
ing them, and sequentially outputting new data. 
[0068] Especially, pipeline processing by the spatial 
filter 2 means an operation of sequentially reading a plu- 
rality of pixels from an input image 14 and sequentially 
calculating and outputting new luminance values. 
[0069] Generally, when the spatial frequency char- 
acteristic of a matrix space having MxM pixels is to be 
adjusted, a new luminance value V P ' of a central pixel P 
located at the center of the matrix space can be 
expressed as the following general equation using the 
luminance values of the peripjne^al pixels. 

v P ' = v P • R P + ££(Vg • R ( ) 

i=1j=1 0) 
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R p + EE R ii = 1 

where is the luminance value of a peripheral pixel in 
the matrix space, Ry is a filter coefficient, i.e., peripheral 
coefficient corresponding to the peripheral pixel, V P is 
the luminance value of the central pixel P in the matrix 
space, and Rp is a filter coefficient, i.e., central coeffi- 
cient corresponding to the central pixel. 
[0070] In addition, i and j are integers from 1 to M 
excluding i = j = (M + 1)/2 (i.e., the central pixel posi- 
tion). 

[0071] The central coefficient Rp and peripheral 
coefficients Ry are selected such that the sum of the 
central coefficient R P and all peripheral coefficients 
becomes 1 . 

[0072] Thus, the luminance value gain by spatial 
frequency characteristic adjustment is 1, and only the 
spatial frequency characteristic is adjusted without 
changing the brightness of the entire image before and 
after adjustment. 

[0073] Referring to Figs. 7A to 7C, the spatial fre- 
quency characteristic of a matrix space having 5x5 pix- 
els (M = 5) is adjusted. 

[0074] The input image 14 is constructed by a 
number of pixels arrayed in a matrix in a horizontal 
direction i and vertical direction j, as shown in Fig. 7A. 
[0075] From luminance data Y of this input image 
14, a matrix space having MxM pixels (M = 5) with the 
central pixel P located at the center is extracted, as 
shown in Fig. 7B. 

[0076] On the basis of the luminance value Vp of 
the central pixel P of the matrix space, the luminance 
values Vy of the peripheral pixels, and the filter coeffi- 
cients shown in Fig. 7C, the new luminance value V P ' of 
the central pixel P is calculated using the above- 
described equations (1). 

[0077] For example, assume that the central coeffi- 
cient R P is 2 5 (= 32), and peripheral coefficients R n to 
R 55 are -1, as shown in Fig. 8A. In this case, as shown 
in Fig. 8B, a totalizer 20 calculates the total sum of lumi- 
nance values to V 55 of the peripheral pixels. When 
this total sum is multiplied by -1 by a multiplier (periph- 
eral multiplier) 21 , the total sum of products of the lumi- 
nance values V-,! to V 55 of the peripheral pixels and 
corresponding peripheral coefficients R^ to R 55 is 
obtained. 

[0078] Also, the luminance value V P of the central 
pixel is multiplied by the central coefficient R P by a mul- 
tiplier (central multiplier) 22, and the multiplied value is 
added to the output from the multiplier 21 by an adder 
23. 

[0079] When the output from the adder 23 is divided 
by a gain adjustment coefficient K (= 2 3 ) by a divider 24, 
the new luminance value V P ' of the central pixel P is 
obtained, with which the luminance value gain by spatial 
frequency characteristic adjustment is 1, and the bright- 
ness of the entire image equals that of the input image 
14. 
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[0080] As for the calculation process of the totalizer 
20, the luminance values of the peripheral pixels can be 
divided into pixel groups A(1), A(2), B(3), A(4), and A(5) 
in the vertical direction j. When five pixels V M to V j5 con- 
5 secutive in the vertical direction j are sequentially 
received, as shown in Fig. 7B, the sums of luminance 
values of these pixel groups can be obtained at timings 
i = 1 to 5. 

[0081] The pixel value of the central pixel V p i.e., 

10 the pixel group E(3) is also obtained at a timing i = 3. 
[0082] Hence, when the sums of the luminance val- 
ues of the pixel groups A, B, and E are calculated at the 
time of input and sequentially shifted and held at the 
timings i = 1 to 5, the total sum of the luminance values 

15 of all pixel groups necessary for the totalizer 20 can be 
obtained at a timing i = 5, and the new luminance value 
V P ' of the central pixel is obtained. 
[0083] As is apparent from the fact that a new pixel 
value V 43 * of a pixel adjacent to the central pixel in the 

20 direction i is automatically calculated at the next timing i 
= 6, pipeline processing of sequentially receiving the 
luminance values to V j5 of five pixels consecutive in 
the vertical direction j and sequentially calculating the 
new pixel value of the central pixel is realized. 

25 [0084] Figs. 9 and 10 show the detailed arrange- 
ment of the spatial filter. 

[0085] Referring to Fig. 9, an adder (block adder) 
20A calculates a sum A(i) of the luminance values V M to 
V5 of five pixels consecutive in the vertical direction j, 

30 which are parallelly input at the timing i, and an adder 
(block adder) 20B calculates a sum B(i) of the lumi- 
nance values Vj^Vjg, V i4 , and V i5 . 
[0086] Each of shift registers 200, 210, and 220 is 
formed from a plurality of 1 -pixel clock delays connected 

35 in series, and shifts, holds, and outputs the value A(i) at 
each timing i on the basis of a clock signal in the hori- 
zontal direction i. 

[0087] The totalizer 20 calculates a total sum G of 
the output A(i) from the adder 20A and outputs A(i-1), 

40 B(i-2), A(i-3), and A(i-4) from predetermined 1 -pixel 
clock delays of the shift registers 200, 210, and 220. 
[0088] The shift register 210 outputs the luminance 
value V P of the central pixel P, i.e., E(i-2) as a value F. 
[0089] Referring to Fig. 10, the multiplier (central 

45 multiplier) 22 multiplies the value F by the central coeffi- 
cient R p the multiplier (peripheral multiplier) 21 multi- 
plies the total sum G by the inverse peripheral 
coefficients Rn to R55, the adder 23 adds the outputs 
from the multipliers 21 and 22 and the divider 24 divides 

50 the output from the adder 23 by the gain adjustment 
coefficient K (= 2 3 ). 

[0090] With this arrangement, at, e.g., the timing i = 
5, the spatial filter shown in Fig. 8B is constructed, and 
the new luminance value Vp of the central pixel P is out- 
55 put. 

[0091] When the values of the central coefficient R p 
peripheral coefficient R^ to R^, and the gain adjust- 
ment coefficient K are selected under the following con- 
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ditions, the calculation process of the new luminance 
value V P ' of the central pixel can be expressed by addi- 
tion of integers and bit shift. 

N &P = r i ' 2 1 + r 2 * 2 2 +...+ r m • 2 m (2) 
££R jj = s 1 -2 1 + s 2 . 2 2 + ... + s n -2" 

=1 j=1 N M 

R P + LL R ij= K = 2 k 

1=1 j=l 

where m and n are positive integers, r-,, r 2 ,..., r m are 0 or 
1, and s 2 ,..., s n are 0 or -1 . 

[0092] More specifically, the sum of power values of 
2 is selected as the central coefficient R p and the 
peripheral coefficient R n to R55 are selected such that 
the sum of the central coefficient R P and the total sum 
of the peripheral coefficients to R 55 equals the sum 
of power values of 2. 

[0093] In addition, a value obtained by adding the 
central coefficient R P to the sum of the peripheral coef- 
ficients R n to R 55 is set as the gain adjustment coeffi- 
cient K which equals a power value of 2. 
[0094] With this arrangement, the adders 20A, 20B, 
and 23 required to realize equations (1) can be imple- 
mented by addition of integers, and the multipliers 21 
and 22 and divider 24 can be implemented by bit shift, 
so the circuit arrangement of the spatial filter can be 
greatly simplified. 

[0095] Hence, the processing time necessary for 
adjusting the spatial frequency characteristic can be 
shortened, and power consumption can be reduced. 
[0096] In the above description, a single power 
value of 2, i.e., 2 5 is selected as the central coefficient 
Rp To select the sum of a plurality of power values of 2, 
a plurality of multipliers 22 are used in correspondence 
with the power values of 2. 

[0097] For example, as shown in Fig. 1 1 , when 2 5 + 
2 3 is used as the central coefficient R p two multipliers 
26A and 26B are parallelly arranged in place of the mul- 
tiplier 22 in correspondence with the two power values. 
[0098] ' In this case, as the gain adjustment coeffi- 
cient K, the sum (= 2 4 ) of the central coefficient R P (= 2 5 
+ 2 3 ) and the sum of the peripheral coefficients (= -24) 
is selected. 

[0099] The output from an adder 27 is divided by 
the gain adjustment coefficient K by a divider 28, and 
the new luminance value V P ' of the central pixel P is 
obtained, with which the brightness of the entire image 
equals that of the input image 14. 
[0100] Fig. 12 shows the filter characteristic of the 
spatial filter. A characteristic 29A is obtained when the 
filter coefficients shown in Fig. 8A are used, i.e., when 
the combination of the filter coefficients shown in Figs. 9 
and 10 is used. 

[0101] A characteristic 29B is obtained when the 
combination of the filter coefficients shown in Figs. 9 
and 1 1 is used. Unlike the characteristic 29A, the char- 
acteristic 29B has a high gain in the intermediate- and 



high-frequency ranges of the spatial frequency because 
of the larger central coefficient R P 
[0102] The third embodiment of the present inven- 
tion will be described next with reference to Fig. 1 3. 
5 [0103] When the spatial frequency characteristic is 
adjusted using a spatial filter, the optimum filter charac- 
teristic changes depending on a pixel contained in a 
matrix space to be processed. 

[0104] In this embodiment, a plurality of filter char- 
to acteristics are prepared. On the basis of a predeter- 
mined statistic amount calculated from the luminance 
values of pixels contained in a matrix space, one of the 
filter coefficients is selected to adjust the spatial fre- 
quency characteristic of an input image. 
15 [0105] Referring to Fig. 1 3, filter coefficient sections 
30A to 30C have different filter characteristics. A selec- 
tion control section 31 selects an optimum filter charac- 
teristic on the basis of a predetermined statistic amount 
calculated from the luminance values of pixels con- 
20 tained in a matrix space. A selector 36 selects one of 
the outputs from the filter coefficient sections 30A to 
30C on the basis of an instruction from the selection 
control section 31. 

[0106] The filter coefficients shown in Figs. 10 and 
25 11 are used by the filter coefficient sections 30A and 
30C. The filter coefficient section 30B uses a flat filter 
characteristic and therefore directly outputs an input 
value F. 

[0107] The selection control section 31 selects one 
30 of the filter characteristics on the basis of a predeter- 
mined statistic amount calculated from the luminance 
values of pixels contained in a matrix space, such as the 
average luminance of pixels in the matrix space, the dif- 
ference between the luminance value of the central pixel 
35 and the average luminance in the matrix space, or the 
difference between the luminance value of the central 
pixel and the luminance value of the farthest pixel in the 
matrix space. 

[0108] Referring to Fig. 13, the selection control 
40 section 31 uses the same circuit arrangement as that of 
the filter coefficient section 30A or 30C and comprises 
multipliers 33A and 33B for multiplying the value F by 
predetermined coefficients, a multiplier 32 for multiply- 
ing a total sum G by a predetermined coefficient, an 
45 adder 34 for adding the outputs from the multipliers 
33A, 33B, and 32 and a determination section 35 for 
determining an optimum filter coefficient on the basis of 
the output level of the adder 34. 

[0109] The circuit arrangement shown in Fig. 9 or 
so 15 (to be described later) is connected to the input side 
of the circuit section shown in Fig. 13. 
[01 10] As described above, on the basis of a prede- 
termined statistic value calculated from the luminance 
values of pixels contained in a matrix space, one of the 
55 filter coefficients is selected to adjust the spatial fre- 
quency characteristic of an input image. Even when the 
luminance values of pixels contained in the matrix 
space are unevenly distributed, the spatial frequency 
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characteristic can be adjusted using a filter characteris- 
tic (optimum filter characteristic) corresponding to the 
region. 

[0111] For example, if the difference in luminance 
between the central pixel and a peripheral pixel is small, 
a filter coefficient having no large gain for a high-fre- 
quency range is selected to prevent emphasis small 
noise. Conversely, by emphasis, an image concealed in 
a dark (or bright) portion can be made clear. 
[01 1 2] The fourth embodiment of the present inven- 
tion will be described next with reference to Figs. 14A 
and 14B. 

[0113] Figs. 14A and 14B show a spatial filter 
according to the fourth embodiment. Fig. 14A shows fil- 
ter coefficients, and Fig. 14B shows the arrangement of 
the spatial filter. 

[0114] In the above description, the spatial filter 
uses filter coefficients including peripheral coefficients 
all having the same value and a central coefficient hav- 
ing a different value. In this embodiment, a case 
wherein pipeline processing is performed using filter 
coefficients having different values as peripheral coeffi- 
cients will be described. 

[01 15] In this embodiment, filter characteristics hav- 
ing different values are realized as peripheral coeffi- 
cients by overlapping the pixel groups used in the 
above-described second embodiment by the coefficient 
value. 

[0116] For example, as shown in Fig. 14A, a case 
wherein of filter coefficients to be used, the coefficients 
of peripheral pixels around the central pixel, i.e., pixels 
separated one pixel distance from the central pixel are - 
2, and the coefficients of pixels around these pixels are 
-1, will be examined. 

[0117] As shown in Fig. 14B, this case can be 
regarded that pixel groups A(1), A(2), B(3), A(4), and 
A(5) with the coefficient of -1 in the case of Fig. 8B over- 
lap new pixel groups C(2), D(3), and C(4) with the coef- 
ficients of -1. 

[01 18] The sums of luminance values of these pixel 
groups are totalized by a totalizer 50. The output is mul- 
tiplied by the polarity of the peripheral coefficients of -1 
by a multiplier (peripheral multiplier) 51 , so the total sum 
of products of luminance values to V 55 of the 
peripheral pixels and corresponding peripheral coeffi- 
cients Rn to R 55 is obtained. 

[0119] As in the above-described case, a lumi- 
nance value V P of the central pixel is multiplied by a 
central coefficient Rp by a multiplier (central multiplier) 
52, and the multiplied value is added to the output from 
the multiplier 51 by an adder 53. 

[0120] After that, the output from the adder 53 is 
divided by a gain adjustment coefficient K (= 2 5 ) by a 
divider 54. A new luminance value V P ' of a central pixel 
P is obtained, with which the luminance value gain by 
spatial frequency characteristic adjustment is 1 , and the 
brightness of the entire image equals that of an input 
image 14. 



[0121] To perform this by pipeline processing, 
adders (block adders) 50A and 50B are provided in cor- 
respondence with the adders 20A and 20B shown in 
Fig. 8A, as shown in Fig. 15. 
5 [0122] In addition, shift registers 500, 510, and 520 
are provided in correspondence with the shift registers 
200,210, and 220. 

[0123] An adder (block adder) 50C for obtaining the 
total sum of luminance values V i2 to of a new pixel 
10 group C, and an adder (block adder) 50D for obtaining 
the total sum of the luminance values V i2 and V14 of a 
pixel group D are provided. 

[0124] Also, shift registers 530 and 540 for shifting, 
holding, and outputting the outputs C(i) and D(i) from 

15 the adders 50C and 50D at each timing i on the basis of 
a clock signal in a horizontal direction i are provided. 
[01 25] With this arrangement, the totalizer 50 calcu- 
lates a total sum G of outputs A(i), A(i-1), C(i-1), B(i-2), 
D(i-2), A(i-3), C(i-3), and A(i-4) from predetermined 1- 

20 pixel block delays of the shift registers 500 to 540. 

[0126] The shift register 51 0 outputs the luminance 
value Vp of the central pixel R i.e., E(i-2) as a value F. 
[0127] Referring to Fig. 16, a multiplier (central mul- 
tiplier) 52 multiplies the value F by the central coefficient 

25 R P A multiplier (peripheral multiplier) 51 multiplies the 
total sum G by the polarity of the peripheral coefficients 
R 1t to R 55 . An adder 53 adds the outputs from the mul- 
tipliers 51 and 52. A divider 54 divides the output from 
the adder 53 by the gain adjustment coefficient K (= 2 5 ). 

30 [0128] With this arrangement, the spatial filter 
shown in Fig. 14B is constructed at, e.g., a timing i = 5, 
and the new luminance value V P ' of the central pixel P is 
output. 

[0129] Generally, when filter coefficients including 

35 peripheral coefficients with the same value and a differ- 
ent central coefficient are used, as shown in Fig. 8A, a 
filter characteristic representing that the gain peak is 
present in the intermediate-frequency range of the spa- 
tial frequency, and the gain gradually attenuates from 

40 the intermediate-frequency portion to the high-fre- 
quency portion is obtained, as shown in Fig. 12. 
[0130] To the contrary, when different coefficients 
are given in units of pixel groups separated from the 
central pixel by the same number of pixels, as shown in 

45 Fig. 14A, the filter characteristic in the high-frequency 
range of the spatial frequency can be controlled. 
[0131] When the absolute value of the peripheral 
coefficient is increased as it becomes close to the cen- 
tral pixel, the gain of high-frequency range can be 

50 larger, as shown in Fig. 17. In addition, an intermediate 
image 6 with emphasized image details can be 
obtained. 

[0132] In this embodiment as well, when the values 
of the central coefficient R p peripheral coefficients R^ 
55 to R55, and gain adjustment coefficient K are selected in 
accordance with the conditions represented by equa- 
tions (2), the process of calculating the new luminance 
value V P of the central pixel can be expressed by addi- 
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tion of integers and bit shift, as in the second embodi- 
ment, and the same functions and effects as described 
above can be obtained. 

[0133] The circuit arrangement shown in Fig. 14B 
includes the circuit arrangement shown in Fig. 8B. 
When an arbitrary one of the outputs from the shift reg- 
isters can be selected as an input to the totalizer 50 
shown in Fig. 14B, a plurality of filter coefficients can be 
easily switched. 

[0134] Fig. 1 8 shows a 3D model representing filter 
characteristics of the spatial filter using the filter coeffi- 
cients shown in Fig. 14A. A section along the X or Y 
direction corresponds to the characteristic shown in Fig. 
17. 

[0135] Fig. 19 shows a 3D model representing the 
synthesized characteristics of the spatial filter and two- 
dimensional DCT filter. 

[0136] Referring to Fig. 1 9, the spatial filter charac- 
teristic shown in Fig. 18, and the two-dimensional DCT 
filter characteristic shown in Fig. 4, i.e... filter character- 
istics 7A and 7B in Fig. 1B. are synthesized. Thus, a 
complex filter characteristic 7 for spatial frequency 
adjustment can be obtained. 

[0137] As has been described above, according to 
the present invention, a spatial filter using a first coeffi- 
cient having a first filter characteristic which forms a 
desired spatial frequency adjustment filter characteristic 
in cooperation with a second filter characteristic, and an 
orthogonal transform section for performing two-dimen- 
sional orthogonal transform for compressing an inter- 
mediate image generated by the spatial filter, using a 
second coefficient having the second filter characteristic 
which forms the desired spatial frequency adjustment 
filter characteristic in cooperation with the first filter 
characteristic are provided to adjust the spatial fre- 
quency characteristic by both the spatial filter and the 
orthogonal transform section. 

[0138] With this arrangement, the desired filter 
characteristic for spatial frequency adjustment can be 
separated into the first and second filter characteristics 
suitable for processing by the spatial filter and orthogo- 
nal transform section, and the spatial frequency charac- 
teristic can be adjusted by both the spatial filter and the 
orthogonal transform section. Unlike the prior art using 
a single filter characteristic, the spatial frequency char- 
acteristic can be adjusted, and an input image can be 
compressed using a desired filter characteristic for the 
image without adding any new circuit arrangement. 

Claims 

1. An image processing apparatus which, for an input 
two-dimensional image constructed by arraying, in 
a matrix, a number of pixels each representing a 
luminance value at a corresponding position, 
adjusts a spatial frequency characteristic on the 
basis of a desired spatial frequency adjustment fil- 
ter characteristic, and compresses the image, char- 



acterized by comprising: 

a spatial filter (2) for obtaining a new luminance 
value of each pixel of an input image (14) on 

5 the basis of a first coefficient having a first filter 

characteristic which forms the desired spatial 
frequency adjustment filter characteristic in 
cooperation with a second filter characteristic, 
thereby generating a two-dimensional interme- 

10 diate image (6) which has the adjusted spatial 

frequency characteristic of the input image; 
and 

an orthogonal transform section (4) for per- 
forming two-dimensional orthogonal transform 

15 for the intermediate image (6) on the basis of a 

second coefficient which has the second filter 
characteristic, which forms the desired spatial 
frequency adjustment filter characteristic in 
cooperation with the first filter characteristic, 

20 and is used for two-dimensional orthogonal 

transform for compressing the intermediate 
image (6) generated by said spatial filter, 
thereby generating image data which has the 
adjusted spatial frequency characteristic of the 

25 intermediate image (6) and has undergone 

two-dimensional orthogonal transform for 
image compression. 

2. An apparatus according to claim 1, wherein said 
30 spatial filter (2) selects a first region constructed by 

M x M pixels (M is a positive odd number; M u 3) 
including, as a central pixel, an arbitrary pixel of the 
input two-dimensional image, totalizes MxM prod- 
ucts of the M x M first coefficients having the first fil- 

35 ter characteristic and pixels in the first region 
corresponding to the coefficients to obtain a new 
luminance value of the central pixel, and sequen- 
tially performs the operation in units of pixels con- 
structing the input two-dimensional image, thereby 

40 generating the two-dimensional intermediate image 
(6) having the adjusted spatial frequency character- 
istic of the input image (14). 

3. An apparatus according to claim 2, wherein as the 
45 first coefficients, a central coefficient corresponding 

to the central pixel in the first region and repre- 
sented by a sum of power values of 2, and periph- 
eral coefficients corresponding to peripheral pixels 
formed from pixels in the first region except the cen- 
50 tral pixel are used, a sum of the central coefficient 
and a total sum of the peripheral coefficients having 
a power value of 2. 

4. An apparatus according to claim 3, wherein of the 
55 peripheral coefficients, all peripheral coefficients 

separated outward from the central coefficient by 
the same number of pixels have the same power 
value of 2. 
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5. An apparatus according to claim 2, wherein of the 
first coefficients, a central coefficient R P corre- 
sponding to the central pixel in the first region and a 
peripheral coefficient Ry corresponding to a periph- 
eral pixel in the first region except the central coeffi- 5 
cient R P satisfy 

M ^P = r i * 2 1+r 2 • 2 2 +-+r m • 2 m (3) 
LI R ii =s i -2 1 +s 2 • 2 2 + „.+ s n -2 n 

i=1j=1 MM 10 

Rp + XX Rij=K = 2 k 

i=1 j=1 

where m and n are positive integers, r-,, r 2 , r m 
are 0 or 1 , and s,, s 2 ,..., s n are 0 or -1. 15 

6. An apparatus according to claim 1, wherein said 
orthogonal transform section (4) segments the 
intermediate image (6) generated by said spatial fil- 
ter (2) into a plurality of second regions each con- 20 
structed by N x N pixels (N is an integer; N s: 2), and 
performs two-dimensional orthogonal transform in 
units of second regions using N x N second coeffi- 
cients having the second filter characteristic, 
thereby generating the image data which has the 25 
adjusted spatial frequency characteristic of the 
intermediate image (6) and has undergone two- 
dimensional orthogonal transform for image com- 
pression. 

30 

7. An apparatus according to claim 6, wherein as the 
second coefficients, N x N coefficients obtained by 
individually multiplying or adding N x N filter coeffi- 
cients for adjusting the spatial frequency character- 
istic of the intermediate image (6) and N x N 35 
transform coefficients used for two-dimensional 
orthogonal transform of the intermediate image are 
used. 

8. An apparatus according to claim 2, wherein said 40 
spatial filter (2) adjusts the spatial frequency char- 
acteristic of the input image (14) using, of the plural- 
ity of first coefficients having different spatial 
frequency characteristics, a first coefficient 
selected on the basis of a predetermined statistic 45 
amount calculated from the luminance values of the 
pixels contained in the first region. 

9. An apparatus according to claim 6, wherein said 
orthogonal transform section (4) performs two- so 
dimensional orthogonal transform for adjustment of 
the spatial frequency characteristic of the interme- 
diate image (6) and image compression by two- 
dimensional orthogonal transform using, of the plu- 
rality of second coefficients having different spatial 55 
frequency characteristics, a second coefficient 
selected on the basis of a predetermined statistic 
amount calculated from the luminance values of the 



pixels contained in the second region. 

10. An apparatus according to claim 8, wherein as the 
statistic amount, an average luminance of the pixels 
in each region, the difference between the lumi- 
nance value of the central pixel and the average 
luminance of the pixels in each region, the differ- 
ence between the luminance value of the central 
pixel and a value obtained by multiplying a pixel in 
each region by a predetermined coefficient, or the 
difference between the luminance value of the cen- 
tral pixel and the luminance value of the farthest 
pixel in each region is used. 

11. An apparatus according to claim 9, wherein as the 
statistic amount, an average luminance of the pixels 
in each region, the difference between the lumi- 
nance value of the central pixel and the average 
luminance of the pixels in each region, the differ- 
ence between the luminance value of the central 
pixel and a value obtained by multiplying a pixel in 
each region by a predetermined coefficient, or the 
difference between the luminance value of the cen- 
tral pixel and the luminance value of the farthest 
pixel in each region is used. 

12. An apparatus according to claim 1 , wherein the first 
coefficients comprise a central coefficient having a 
positive coefficient value corresponding to a central 
pixel as an arbitrary pixel in a first region having M 
x M pixels (M is an odd number; M^3) and (MxM 
- 1 ) peripheral coefficients corresponding to periph- 
eral pixels formed from pixels in the first region 
except the central pixel in the input image (14) 
formed from a number of pixels two-dimensionally 
arrayed along directions i and j perpendicular to 
each other, each peripheral coefficient having a 
negative coefficient value, 

said spatial filter (2) has a pipeline processing 
section comprising: 

a plurality of block adders (20A, 20B) for calcu- 
lating and outputting a sum of luminance val- 
ues of pixels belonging to an individual block in 
units of predetermined blocks each con- 
structed by at least one of the M pixels paral- 
lelly received from the input image; 
a plurality of shift registers (200, 21 0, 220) pro- 
vided in correspondence with said block 
adders to sequentially shift outputs from said 
block adders in synchronism with a predeter- 
mined clock signal by a predetermined number 
of stages, and hold and output the outputs; 
an adder (20) for selectively totalizing predeter- 
mined output values of output values from said 
block adders and output values from said shift 
registers to output a value obtained by totaliz- 
ing (MxM - 1) products of the luminance val- 
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ues of the individual peripheral pixels of the M 
x M pixels in the first region and absolute val- 
ues of the peripheral coefficients correspond- 
ing to the peripheral pixels; 

a peripheral multiplier (21) for multiplying an 5 
output from said totalizer by -1 ; 
a central multiplier (22) for multiplying the lumi- 
nance value of the central pixel, which is held 
by one of said shift registers, by the central 
coefficient and outputting the value; w 
an adder (23) for adding an output from said 
central multiplier to an output from said periph- 
eral multiplier and outputting a sum value; and 
a divider (24) for dividing the output from said 
adder to output a new luminance value of the 15 
central pixel, and 

the two-dimensional intermediate image (6) 
having the adjusted spatial frequency charac- 
teristic of the input image (14) is obtained by 
scanning the pixels on the input image one by 20 
one in an i direction and one by one in a j direc- 
tion in synchronism with a predetermined clock 
signal to parallel ly receive M pixels arrayed 
adjacent along the j direction by said pipeline 
processing section and sequentially calculating 25 
the new luminance value of the central pixel of 
the received M x M pixels. 

13. An apparatus according to claim 12, the central 
coefficient of the first coefficient is a power value of 30 
2, and 

said central multiplier (22) bit-shifts the lumi- 
nance value of the central pixel in an upper bit 
direction by the power value of 2 forming the 35 
central coefficient, thereby calculating and out- 
putting the product of the luminance value of 
the central pixel and the central coefficient. 

14. An apparatus according to claim 12, the central 40 
coefficient of the first coefficient is a sum of a plural- 
ity of power values of 2, 

said central multiplier comprises a plurality of 
multipliers (26A, 26B) parallelly arranged in 45 
correspondence with the power values of 2 
forming the central coefficient, and 
each multiplier bit-shifts the luminance value of 
the central pixel in the upper bit direction by the 
corresponding power value of 2, thereby calcu- 50 
lating and outputting the product of the lumi- 
nance value of the central pixel and the central 
coefficient. 

15. An apparatus according to claim 12, wherein the 55 
central coefficient and the peripheral coefficients of 
the first coefficient are set such that a sum of the 
central coefficient and a total sum of the peripheral 



coefficients has a power value of 2, and 

said divider (24) divides the output from said 
adder by bit-shifting the output from said adder 
in a lower bit direction by the power value of 2 
representing the sum of the central coefficient 
and the total sum of the peripheral coefficients. 

16. An apparatus according to claim 1, wherein as the 
first filter characteristic, a characteristic for empha- 
sizing intermediate- to high-frequency portions of 
the spatial frequency characteristic is used. 

17. An apparatus according to claim 16, wherein as the 
second filter characteristic, a characteristic for 
attenuating a high-frequency portion of the spatial 
frequency characteristic is used. 

18. An apparatus according to claim 2, wherein the first 
filter characteristics having different spatial fre- 
quency characteristics are individually used for a 
luminance signal and color difference signals. 

19. An apparatus according to claim 2, wherein the 
second filter characteristics having different spatial 
frequency characteristics are individually used for a 
luminance signal and color difference signals. 
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